Almost Optimal Explicit Johnson-Lindenstrauss Transformations
نویسنده
چکیده
The Johnson-Lindenstrauss lemma is a fundamental result in probability with several applications in the design and analysis of algorithms in high dimensional geometry. Most known constructions of linear embeddings that satisfy the Johnson-Lindenstrauss property involve randomness. We address the question of explicitly constructing such embedding families and provide a construction with an almost optimal use of randomness: For 0 < δ, ε < 1, we give an explicit generator G : {0, 1} → Rs×n for s = O(log(1/δ)/ε) such that for all w ∈ R, ‖w‖ = 1, Pr y∈u{0,1} [ |‖G(y)w‖ − 1| > ε ] ≤ δ, and seed-length r = O ( log(n/δ) · log ( log(n/δ) ε )) . In particular, for δ = 1/poly(n) and fixed ε > 0 we get seed-length O(log n log log n). Previous constructions required at least O(log n) random bits to get polynomially small error. ISSN 1433-8092 Electronic Colloquium on Computational Complexity, Revision 1 of Report No. 183 (2010)
منابع مشابه
Almost Optimal Explicit Johnson-Lindenstrauss Families
The Johnson-Lindenstrauss lemma is a fundamental result in probability with several applications in the design and analysis of algorithms. Constructions of linear embeddings satisfying the JohnsonLindenstrauss property necessarily involve randomness and much attention has been given to obtain explicit constructions minimizing the number of random bits used. In this work we give explicit constru...
متن کاملOptimal Bounds for Johnson-Lindenstrauss Transformations
In 1984, Johnson and Lindenstrauss proved that any finite set of data in a high-dimensional space can be projected to a lower-dimensional space while preserving the pairwise Euclidean distance between points up to a bounded relative error. If the desired dimension of the image is too small, however, Kane, Meka, and Nelson (2011) and Jayram and Woodruff (2013) independently proved that such a pr...
متن کاملThe Johnson-Lindenstrauss Lemma Meets Compressed Sensing
We show how two fundamental results in analysis related to n-widths and Compressed Sensing are intimately related to the Johnson-Lindenstrauss lemma. Our elementary approach is based on the same concentration inequalities for random inner products that have recently provided simple proofs of the Johnson-Lindenstrauss lemma. We show how these ideas lead to simple proofs of Kashin’s theorems on w...
متن کاملOptimal Fast Johnson-Lindenstrauss Embeddings for Large Data Sets
We introduce a new fast construction of a Johnson-Lindenstrauss matrix based on the composition of the following two embeddings: A fast construction by the second author joint with Ward [1] maps points into a space of lower, but not optimal dimension. Then a subsequent transformation by a dense matrix with independent entries reaches an optimal embedding dimension. As we show in this note, the ...
متن کاملRobustness Properties of Dimensionality Reduction with Gaussian Random Matrices
In this paper we study the robustness properties of dimensionality reduction with Gaussian random matrices having arbitrarily erased rows. We first study the robustness property against erasure for the almost norm preservation property of Gaussian random matrices by obtaining the optimal estimate of the erasure ratio for a small given norm distortion rate. As a consequence, we establish the rob...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
- CoRR
دوره abs/1011.6397 شماره
صفحات -
تاریخ انتشار 2010